Three-Component Fermionic Atoms with Repulsive Interaction in Optical Lattices 
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We investigate three-component (colors) repulsive fermionic atoms in optical lattices using the 
dynamical mean field theory. Depending on the anisotropy of the repulsive interactions, either a 
color density-wave state or a color selective staggered state appears at half filling. In the former 
state, pairs of atoms with two of the three colors and atoms with the third color occupy different sites 
alternately. In the latter state, atoms with two of the three colors occupy different sites alternately 
and atoms with the third color are itinerant throughout the system. When the interactions are 
isotropic, both states are degenerate. We discuss the results using an effective model. 
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Since the first realization of degenerate K fermionic 
atoms [l| , cold fermionic atoms have been studied exten- 
sively. By using a Feshbach resonance [2|, both interac- 
tion strength and its sign can be controlled. In addition, 
optical lattices formed by standing waves of light pro- 
vide us with diverse interaction configurations. Combin- 
ing these experimental techniques, fascinating aspects of 
many-body effects have been revealed. A superfluidity of 
pairs of fermionic atoms was observed for 6 Li fermionic 
atoms with an attractive interaction [3(. By increasing 
the depth of the optical lattice potential near the Fesh- 
bach resonance, a superfluid-insulator transition was also 
observed. The Mott insulating state was realized for 40 K 
fermionic atoms with repulsive interaction by appropri- 
ately tuning the ratio between the interaction and the 
kinetic energy 0, @ ■ Research on cold fermionic atoms 
has been extended to topics that are not found in ordi- 
nary condensed matter physics. 

Recently, a balanced population of Li fermionic atoms 
with three kinds of internal degrees of freedom was suc- 
cessfully created [1, 0] ■ The observed anomalous increase 
in the three-body loss was discussed in connection with 
the Efimov trimer state For the attractive three- 

component (colors) fermionic atoms in optical lattices, 
it was shown theoretically that atoms with two of the 
three colors form Cooper pairs, yielding a color superfluid 
(CSF) [n|>[3- As the strength of the attractive interac- 
tion increases, there is a quantum phase transition from 
the CSF state to the trionic state, where three atoms 
with different colors form singlet bound states [ill EH ■ 
Finite-temperature properties including the phase dia- 
gram of the Fermi liquid state, the CSF state, and the 
trionic state have been investigated [l3j . 

Novel ordered states of repulsive TV-component cold 
fermionic atoms have been investigated as regards 
isotropic interactions on a square lattice [Tij . It was 
shown that for N > 6 the staggered flux state appears 
at half filling. By contrast, for N < 6, the density-wave 
(DW) state appears at half filling, where, e.g. for N = 3, 
pairs of atoms with two of the three colors and atoms with 



the third color occupy different sites alternately (color 
DW state). In real systems, the interactions are not nec- 
essarily isotropic. However, our knowledge of the effects 
of the anisotropic interactions is still insufficient. This 
motivates us to investigate the effects of the anisotropy 
of the repulsive interactions. 

In this paper, we investigate three-component 
fermionic atoms with anisotropic repulsive interactions 
in optical lattices. We show that, depending on the 
anisotropy of the interaction, a color DW state and a 
color-selective "antiferromagnetic" (CSAF) state appear 
at half filling, where atoms with two of the three col- 
ors occupy different sites alternately and the third color 
atoms are itinerant throughout the system. For the 
isotropic interactions, we find that both states are de- 
generate. 

In accordance with the conventional model for cold 
atoms in optical lattices [15j . we set the nearest neigh- 
bor hopping and the on-site interaction between atoms 
with different colors. The low-energy properties can be 
described by the following Hamiltonian, 
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H =- {t + [i a Si,j) a\ a a ja 

<i,j> a = l 

+ h^^Uapmallip, (1) 

where the subscript < i,j > is the summation over the 
nearest neighbor sites, a\ a {a.i a ) is the fermionic creation 
(annihilation) operator for the state with color a in the 
ith site and rii a — a\ a a,i a . t denotes the hopping integral, 
fj, a is the chemical potential for the atom with color a, 
and U a /3 is the repulsive interaction between two atoms 
with colors a and (3. We assume a homogeneous optical 
lattice and neglect the confinement potential for a first 
approximation. 

To investigate quantum phase transitions and the 
ground state properties, we employ the dynamical mean 
field theory (DMFT) [l6j]. In DMFT, the lattice model 
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FIG. 1: (Color Online) (a) Quasiparticle weight Z a and (b) 
difference between atom numbers of sublattices with color a 
per site, M a , for U /U = 2 and U'/U = 0.6 as functions of 
£//t. 
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FIG. 2: (Color Online) Difference between atom numbers of 
sublattices with color a per site, M a , for U" /U = 2 and 
U/t — 3 as functions of U' /U. 



is mapped onto an effective impurity model connected 
dynamically to a heat bath. The Green's function is 
obtained via the self-consistent solution of this impu- 
rity problem. This retains nontrivial quantum fluctu- 
ations missing in conventional mean-field theories. We 
apply here the two-site DMFT method to obtain this self- 
consistent solution [ljj , which allows us to study the DW 
states and the Mott insulating states of lattice fermions 

m- 

To examine the color DW state, we divide the bipartite 
lattice into two sublattices |l6|,|l9|. In this procedure, the 
local Green's function has the following form: 



(a) U'/U=0.6 
a=l 1 



tPnc 



(b) U'/U=l. 



S a (w) 



deD{e) 



9a 



- 1 (e,u)-'E a (u) 



LU + Ha — £ 

—e w + p a 

Sa,o(w) 
E B , a (u>) 



(2) 
(3) 
(4) 



where D(e) is the density of states (DOS). We use a 
semicircular DOS obtained for the infinite dimensional 
bipartite Bethe lattice, D{e) = 4/(nW)y/l - 4(e/W) 2 , 
where W(= At) is the bandwidth. Accordingly, qualita- 
tive properties of other bipartite lattices such as square 
and cubic lattices can be discussed using the present re- 
sults. Ha(b). q( w ) is the self-energy of the atoms with 
color a for the A(B) sublattice, which can be obtained 
by solving two effective impurity models. The chemi- 
cal potential is set at fi a — (U a p + C/ 7Q )/2 so that the 
particle-hole symmetry can be realized for each color, and 
thus the atoms of each color achieve half filling. We set 
012 = U, U 23 = U', and U 31 = U" . 

We calculate the quasiparticle weight Z a , which is in- 
versely proportional to the effective mass of the atom 
with color a, and the difference in the atom numbers 
( n A(B),a)i M a = ua,u — n<B,a, between the sublattices 
A and B with color a per site. We also calculate the 
single-particle excitation spectra (SPES), PA(B)a( UJ )j de- 
fined from the imaginary part of the diagonal components 
of the 2x2 Green's function matrix, — (l/Tr)lmG a (u)+i8), 
with S being a small positive number. Because of 
particle-hole symmetry, the relation pAa( u ) = Pbq(-w) 
is satisfied. In the following, the hopping integral t is 
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FIG. 3: (Color Online) Single-particle excitation spectra for 
(a) U'/U = 0.6 and (b) 1.8 by fixing U" /U = 2 and U/t = 3. 



used in units of energy. 

In Fig. [U we show Z a and M a for U"/U = 2 and 
U'/U = 0.6 as functions of U ft. As U/t increases, Z\, Z 2 , 
and Z 3 first decrease and then maintain nonzero values 
even in a large U/t. With increasing U/t, Mj increases 
towards unity, and M 2 and M 3 decrease towards minus 
unity. The results indicate that no Mott transition oc- 
curs, and sites doubly occupied by atoms with colors 2 
and 3 and sites solely occupied by atoms with color 1 ap- 
pear alternately, and form the color DW state. We find 
that Z 2 ~ f irrespective of U/t, implying a weak renor- 
malization effect, and that M 2 approaches minus unity 
very slowly compared with M3 . The results suggest that 
the atoms with color 2 occupy the site more flexibly than 
the atoms with other two colors. 

In Fig. [51 we show M a as functions of U'/U for 
U"/U = 2 and U/t = 3. We find that Mi - 1 and 
M3 ~ —1 irrespective of U'/U, indicating that the atoms 
with colors 1 and 3 occupy the alternating sites rigidly. 
By contrast, M 2 changes from negative to positive with 
increasing U'/U. The results indicate that for U'/U < 1 
the atoms with colors 2 and 3 occupy the same sites 
to prevent the strong repulsions U" and U, while for 
U'/U > 1 the atoms with colors 1 and 2 occupy the 
same sites to prevent the strong repulsions U" and U'. 
Close to U'/U — 1, M 2 ~ 0. In this case, the binding 
of the color 2 atoms to the color DW state becomes very 
weak. At U'/U — 1, M 2 vanishes, suggesting that the 
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FIG. 4: (Color Online) (a) Energies and (b) quasiparticle 
weights for U" /U = 2 and U'/U = 0.6 as functions of U/t. 
(a) The thick (red) line represents the energy of the color DW 
state, while the thin (blue) line represents the energy obtained 
by the two-site DMFT without dividing the bipartite lattice 
into the sublattices. 



atoms with color 2 are itinerant throughout the system. 
In this case, the CSAF state appears. 

We investigate the color DW state in terms of the 
SPES. In Fig. [3 we show the SPES for U'/U = 0.6 
and 1.8 by fixing U"/U = 2 and U/t = 3. We find that 
the SPES have gaps (A Q ) at the Fermi energy lu = 0. 
For U'/U = 0.6, the gap of color 2 (A 2 /t = 1.21) is 
much smaller than those of colors 1 and 3 (Ai/i = 4.02 
and A 3 /t — 3.62). This is because the atoms with col- 
ors 1 and 3 occupy different sites more rigidly to pre- 
vent the largest repulsion U" than the atoms with color 
2. The results are consistent with those for Z a and 
M a shown in Fig. [TJ where M x = 0.95, M 2 = -0.62, 
and M 3 = -0.91 for U"/U = 2, U'/U = 0.6, and 
U/t = 3. For U'/U = 1.8, we obtain the spectral gaps of 
Ai/i = 2.80, A 2 /t = 2.25, and A 3 /t = 3.82. No gap is 
noticeably smaller than the others. The situation is con- 
sistent with the color DW order parameters: Mi =0.85, 
M 2 = 0.82, and M 3 = -0.97 for U"/U = 2, U'/U = 1.8, 
and U/t = 3. 

The results in Figs. Ufa) an< ^ EI a ) show that a small 
spectral gap appears, when one of the three repulsive 
interactions is particularly strong. In this case, fluctu- 
ation effects caused, for example, by temperature are 
considered to have a noticeable influence on the low- 
energy properties. Owing to thermal fluctuation effects, 
the atoms corresponding to the small spectral gap may 
become itinerant. To confirm this consideration, we cal- 
culate Z a using two-site DMFT without dividing the bi- 
partite lattice into sublattices. In this calculation, the 
atoms with different colors do not form any staggered 
state such as the color DW state or the CSAF state. 
Instead, atoms with a strong repulsive interaction oc- 
cupy the sites randomly, obeying a Mott transition. This 
calculation allows us to study quasi-stable states that 
have higher energies than those of the ordered state. In 
fact, the energy obtained by this calculation is slightly 
higher than that of the color DW state as shown in Fig. 
BJa). The quasiparticle weights for the same parameters 
(U"/U = 2 and U'/U = 0.6) as those used for Fig. Q] 
are shown in Fig. 0|b) as functions of U/t. With in- 
creasing U/t, Z a decreases monotonically. Z\ and Z 3 
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FIG. 5: (Color Online) (a) Order parameters and (b) energies 
for U" = U' and U/t = 5 as functions of U'/U. 



decrease and become zero at the same critical U(= U c i), 
which is smaller than the critical U{= U c2 ) for Z 2 . Ac- 
cordingly, for U c \ < U < U c2 , the atoms with colors 1 
and 3 exhibit a Mott transition because of the strong 
interaction U", while the atoms with color 2 behave as 
a Fermi liquid and are itinerant throughout the system. 
Using the analogy of the orbital selective Mott transition 
[20| . this state can be called a color selective Mott tran- 
sition (CSMT) state. For U c2 < U, the Mott insulator 
appears. It was demonstrated that the Mott insulator 
appears at commensurate 1 /3 and 2 /3 fillings (one atom 
and two atoms in each site, respectively) in the isotropic 
interaction system [U [22j ■ We have, in addition, shown 
that if the interactions are anisotropic the Mott insulator 
appears even at incommensurate half filling (non-integer 
1.5 atoms in each site). The present calculation suggests 
that atoms with a small energy gap in the ground state 
may become itinerant at finite temperatures. In this case, 
there may be competition between the color DW state, 
the CSAF state, and the CSMT state depending on the 
anisotropy of the repulsive interactions. This issue con- 
stitutes our future study. 

We have revealed that the anisotropy of the inter- 
actions induces novel quantum phases. We now move 
our attention close to the isotropic interaction point 
(U" = U' = U), i.e. SU(3) point, which was investi- 
gated in Ref. [14j. To this end, we calculate M a , and 
the energies of the color DW state and CSAF state for 
U" = U' and U/t — 5, when U'/U varies across the 
SU(3) point {U'/U = 1). The results for M a are shown 
in Fig. EJa) as functions of U'/U. For U'/U < 0.94 
the CSAF state appears, since Mi < 0, M 2 > 0, and 
M 3 = 0. For U'/U > 1.20 the color DW state appears, 
since M Y < 0, M 2 < 0, and M 3 > 0. We find a hys- 
teresis in 0.94 < U'/U < 1.20, implying a discontinuous 
quantum phase transition. The results for the energies 
are shown in Fig. [SJb) . Although the difference between 
the energies is very small, the CSAF state is the lowest 
for U'/U < 1 and the color DW state is the lowest for 
U'/U > 1. At U'/U = 1, the energies of both states 
cross, which is a manifestation of a discontinuous quan- 
tum phase transition in agreement with the results for 
M a . We have shown that the color DW state and the 
CSAF state are degenerate at the SU(3) point in the 
infinite-dimensional Bethe lattice. As mentioned above, 
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our results can be applied to discuss qualitative prop- 
erties of a square lattice system. In Ref. [l4|, it was 
claimed that the color DW state is the ground state of 
the isotropic interaction system on a square lattice at 
half filling. It may be an interesting issue to investigate 
this degeneracy in other bipartite lattices, e.g. a cubic 
lattice. 

We discuss the three-component lattice fermions at 
half filling using an effective model. This effective model 
is appropriate, when at least one of the three repulsive 
interactions is very strong. When U" is the strongest, 
the atoms with colors 1 and 3 occupy completely dif- 
ferent sites at half filling, forming localized fermions. 
Note that the localized fermions do not necessarily form 
staggered states. To derive the effective Hamiltonian, 
we set Nf = \{n\ — 713 + 1) and iV c = 712, where 
n a = 7}(n,A,a + n B.a)- In this procedure, the atoms with 
color 2 are regarded the spinless fermions. To evaluate 
the interaction between the localized fermions and the 
spinless fermions, and the chemical potentials of both 
type of fermions, the following four states are consid- 
ered: (N f ,N c ) = (1,1), (1,0), (0,1), (0,0). The effective 
Hamiltonian can be obtained as 

= - * E c i°j - "E fa + tif*) 

<i,j> i 

+ (U-U>)J24c*flh, (5) 

i 

where and fi are the annihilation operators of the spin- 
less fermions and the localized fermions, respectively, and 
fj, = \{U - XT') (> 0) [13|. This Hamiltonian is known 
as a Falicov-Kimball model for symmetric half filling, the 
ground state of which is known to be an antiferromag- 
netic DW state 0, [24| . In terms of the original model, 



this ground state is the same as the color DW state. For 
a small U — V , it can be considered that the system con- 
sists of spinless fermions loaded in the staggered periodic 
potential and U — U' induced by the DW state of the lo- 
calized fermions, which corresponds to the AF insulating 
state formed by the color- 1 and -3 atoms in the original 
model. The Fermi surface of the spinless fermions is per- 
fectly nested, resulting in a band-insulating state with a 
small gap corresponding to A2(oc \U — U'\) as shown in 
Fig. |3{a). The CSAF state appearing at U = V can be 
described by the effective model, if the localized fermions 
form the staggered DW state even at U' = U . 

In summary, we have investigated three-component re- 
pulsive fermionic atoms in optical lattices. Depending on 
the anisotropy of the repulsive interaction, the color DW 
state and the CSAF state appear at half filling. Both 
states are degenerate at the SU(3) isotropic interaction 
point. In recent experiments, it was shown that fermionic 
ytterbium atoms ( 173 Yb) were successfully cooled to form 
degenerate Fermi gases [25] . The interaction between 
173 Yb atoms is repulsive and its nuclear spin is I = 5/2 
[26| . Accordingly, 173 Yb fermionic atoms may be a can- 
didate for realizing and studying three-component repul- 
sive fermionic atoms in optical lattices. We hope that our 
results contribute to work on the novel ordered states of 
cold fermionic atoms in optical lattices. 
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